Framework for Classroom Student Grading with Open-Ended Questions: A Text-Mining Approach
نویسندگان
چکیده
The purpose of this paper is to present a framework based on text-mining techniques support teachers in their tasks grading texts, compositions, or essays, which form the answers open-ended questions (OEQ). approach assumes that OEQ must be used as learning and evaluation instrument with increasing frequency. Given time-consuming process for those questions, large-scale use only possible when computational tools can help teacher. This work decision entirely teacher’s task responsibility, not result an automatic process. In context, teacher author included tests, administration results assessment, entire cycle being noticeably short: few days at most. An attempt made address problem. method exploratory, descriptive data-driven, data assumed inputs texts essays compositions created by students answering single test specific occasion. Typically, involves exceedingly small volumes measured power current home computers, but big compared human capabilities. general idea software extract useful features from perform lengthy complex statistical analyses teacher, who, it believed, will combine information his her knowledge experience make decisions mark allocation. A generic path model formulated represent context kind should perform, estimated synthesised using graphic displays. illustrated analysing three corpora 126 originating different real contexts, time periods, educational levels disciplines.
منابع مشابه
Closing in on open–ended patient questionnaires with text mining
Knee injury and Osteoarthritis Outcome Score (KOOS) is an instrument used to quantify patients' perceptions about their knee condition and associated problems. It is administered as a 42-item closed-ended questionnaire in which patients are asked to self-assess five outcomes: pain, other symptoms, activities of daily living, sport and recreation activities, and quality of life. We developed KLO...
متن کاملExploring Effect of Rater on Prediction Error in Automatic Text Grading for Open-ended Question
This paper aims to explore the way of evaluating the automatic text grader for open-ended questions by considering the relationships among raters, grade levels, and prediction errors. The open-ended question in this study was about aurora and required knowledge of earth science and physics. Each student’s response was graded from 0 to 10 points by three raters. The automatic grading systems wer...
متن کاملComparing Human and Automated Evaluation of Open-Ended Student Responses to Questions of Evolution
Written responses can provide a wealth of data in understanding student reasoning on a topic. Yet they are timeand laborintensive to score, requiring many instructors to forego them except as limited parts of summative assessments at the end of a unit or course. Recent developments in Machine Learning (ML) have produced computational methods of scoring written responses for the presence or abse...
متن کاملAffect Detection from Open-Ended Improvisational Text
We report progress on adding affect-detection to a program for virtual dramatic improvisation, monitored by a human director. We have developed an affect-detection module to control an automated virtual actor and to contribute to the automation of directorial functions. The work also involves basic research into how affect is conveyed through metaphor. The relevance of the project to the sympos...
متن کاملThe Turing Ratio: A Framework for Open-Ended Task Metrics
The Turing Test is of limited use for entities differing substantially from human performance levels. We suggest an extension of Turing’s idea to a more differentiated measure the "Turing Ratio" which provides a framework for comparing human and algorithmic task performance, up to and beyond human performance levels. Games and talent levels derived from pairwise comparisons provide examples of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics
سال: 2022
ISSN: ['2227-7390']
DOI: https://doi.org/10.3390/math10214152